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Abstract. In this article we present a statistical version of the Candes-Tao 
restricted isometry property (SRIP for short) which holds in general for any 
incoherent dictionary which is a disjoint union of orthonormal bases. In ad- 
dition, we show that, under appropriate normalization, the eigenvalues of the 
associated Gram matrix fluctuate around A = 1 according to the Wigner semi- 
circle distribution. The result is then applied to various dictionaries that arise 
naturally in the setting of finite harmonic analysis, giving, in particular, a 
better understanding on a remark of Applebaum-Howard-Searle-Calderbank 
concerning RIP for the Heisenberg dictionary of chirp like functions. 



0. Introduction 

Digital signals, or simply signals, can be thought of as complex valued functions 
on the finite field Fp, where p is a prime number. The space of signals H = C (Fp) 
is a Hilbert space of dimension p, with the inner product given by the standard 
formula 



te¥p 

A dictionary D is simply a set of vectors (also called atoms) in Ti.. The number 
of vectors in D can exceed the dimension of the Hilbert space Ti., in fact, the most 
interesting situation is when ^ p = dimTi. In this set-up we define a resolution 
of the Hilbert space H via D, which is the morphism of vector spaces 

e : C(S)) ^ 

given by Q (/) = Ei^es / iv) Vj foi' every f G C (S)). A more concrete way to think 
of the morphism is as a p x matrix with the columns being the atoms in S). 

In the last two decades [11] , and in particular in recent years [H IH O [6l [7l [8] , 
resolutions of Hilbert spaces became an important tool in signal processing, in 
particular in the emerging theories of sparsity and compressive sensing. 



1. The RESTRICTED ISOMETRY PROPERTY 

A useful property of a resolution is the restricted isometry property (RIP for 
short) defined by Candes-Tao in [7]. Fix a natural number n G N and a pair of 
positive real numbers 81,62 G R>o- 
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Definition 1.1. A dictionary S) satisfies the restricted isometry property with co- 
efficients {5i,62,n) if for every subset S d D such that \S\ < n we have 

(1 - <52) 11/11 < lie (/)||<(i + <5i) 11/11, 

for every function / G C (£)) which is supported on the set S . 

Equivalently, RIP can be formulated in terms of the spectral radius of the cor- 
responding Gram operator. Let G (S) denote the composition Q*g o Qg with Qs 
denoting the restriction of Q to the subspace Cs (S)) C C{D) of functions sup- 
ported on the set S. The dictionary 2D satisfies {6i,62,n)-RlP if for every subset 
S C D such that 15*1 < n we have 

62<\\G{S)~Ids\\<di, 

where Ids is the identity operator on Cs (S). 

It is known [2", that the RIP holds for random dictionaries. However, one 
would like to address the following problem (HIiniinilSniinilSlllllSSllMlllSlllIl: 

Problem 1.2. Find deterministic construction of a dictionary S) with \D\ ^ p 
which satisfies RIP with coefficients in the critical regime 

(1.1) 61,62 1 and n — a ■ p, 

for some constant < a < 1. 

2. Incoherent dictionaries 

Fix a positive real number fj, £ M>o. The following notion was introduced in 
[12] and was used to study similar problems in [26l [27] : 

Definition 2.1. A dictionary D is called incoherent with coherence coefficient fi 
(also called fi-coherent) if for every pair of distinct atoms ip,(j} £ D 

\{^,cl^)\<^- 

In this article we will explore a general relation between RIP and incoherence. 
Our motivation comes from three examples of incoherent dictionaries which arise 
naturally in the setting of finite harmonic analysis: 

• The first example |181 119] . referred to as the Heisenherg dictionary Tin, 
is constructed using the Heisenberg representation of the finite Heisenberg 
group H (¥p). The Heisenberg dictionary is of size approximately and 
its coherence coefficient is /i = 1. 

• The second example (TS] [161 [13 j which is referred to as the oscillator dic- 
tionary Do, is constructed using the Weil representation of the finite sym- 
plectic group SL2 (Fp)- The oscillator dictionary is of size approximately 
p^ and its coherence coefficient is = 4. 

• The third example [151 1161 117] , referred to as the extended oscillator dictio- 
nary DeO: is constructed using the Heisenberg- Weil representation [28l[T3] 
of the finite Jacobi group, i.e., the semi-direct product J (Fp) = SL2 (Fp) k 
H (Fp). The extended oscillator dictionary is of size approximately p^ and 
its coherence coefficient is = 4. 
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The three examples of dictionaries we just described constitute reasonable can- 
didates for solving Problem 11.21 They are large in the sense that \D\ ^ p, and 
empirical evidences suggest (see [1^ for the case of D/f ) that they might satisfy RIP 
with coefficients in the critical regime (jl.ip . We summarize this as follows: 

Question: Do the dictionaries Dh,'^o and TIeo satisfy the RIP with coef- 
ficients 61,62 ^ I and n = a ■ p, for some < a < 1? 

3. Main results 

In this article we formulate a relaxed statistical version of RIP, called statistical 
isometry property (SRIP for short) which holds for any incoherent dictionary 2) 
which is, in addition, a disjoint union of orthonormal bases: 

(3.1) D = Y[b,, 

xex 

where Bx = {b^., ..,bP^ is an orthonormal basis of Ti, for every x £ X. 

3.1. The statistical isometry property. Let D be an incoherent dictionary of 
the form (|3.ip . Roughly, the statement is that for S C 1), \S\ = n with n — p^^^, 
for < e < 1, chosen uniformly at random, the operator norm ||G (5) — Ids\\ is 
small with high probability. Precisely, we have 

Theorem 3.1 (SRIP property [11]). For every k £ N, there exists a constant C (k) 
such that the probability 

(3.2) p{\\GiS)-Ids\\>p-'^') <C{k)p^-'^l\ 

The above theorem, in particular, implies that probability P (||G (S*) — Ids\\ >P' 

as p — ^ CX3 faster then p~^ for any / e N. 

3.2. The statistics of the eigenvalues. A natural thing to know is how the 
eigenvalues of the Gram operator G{S) fluctuate around 1. In this regard, we 
study the spectral statistics of the normalized error term 

^{S)^{p/nf'^ {G{S)-Ids). 

Let p-E(s) ~ Y^7=i ^ >'i denote the spectral distribution of £(5*) where Ai, 

1 = 1, ..,n, are the real eigenvalues of the Hermitian operator E (5*). The following 
theorem asserts that p-^ converges in probability as p ^ 00 to the Wigner semicircle 
distribution pg^j (x) = (27r) y/ 4 — x^ ■ l[2.-2] (x) where l[2,-2] is the characteristic 
function of the interval [—2, 2]. 

Theorem 3.2 (Semicircle distribution [S]). We have 

(3.3) lim Pe = psc- 

p — >oo 

Remark 3.3. A limit of the form US. 3\) is familiar in random matrix theory as the 
asymptotic of the spectral distribution of Wigner matrices. Interestingly, the same 
asymptotic distribution appears in our situation, albeit, the probability spaces are of 
a different nature (our probability spaces are, in particular, much smaller). 
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In particular, Theorems 13.11 \3l2\ can be applied to the three examples Dh, So 
and Deo, which are all of the appropriate form (13. ip . Finally, our result gives new 
information on a remark of Applebaum-Howard-Searle-Calderbank |lj concerning 
RIP of the Heisenberg dictionary. 

Remark 3.4. For practical applications, it might be important to compute ex- 
plicitly the constants C (fc) which appears in ^3^. This constant depends on the 
incoherence coefficient fi, therefore, for a fixed p, having fi as small as possible is 
preferable. 
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